PATENT ABSTRACTS OF JAPAN 



(1 1 publication number : 09-215000 
(43)Date of publication of application : 15.08.1997 



51)Int.CI. 


H04N 9/73 






H04N 9/04 




21 Application number : 08-016697 


(71)Applicant 


: CANON INC 


22)Date of filing : 01 .02.1 996 


(72)Inventor : 


TAKAHASHI KENJI 



54) IMAGE PICKUP DEVICE AND IMAGE SIGNAL PROCESSING METHOD 
57)Abstract: 

3 ROBLEM TO BE SOLVED: To provide an image pickup device and an 
mage signal processing method by which images are provided while 
;onsidering the color rendering property of a light source and human color 
;ensing characteristics. 

SOLUTION: Concerning an image signal from an imaging device, ordinary 
vhite balance processing is performed by a white balance processing part 
lot shown in the Figure, and these processed image data and a white 
>alance coefficient in that case are inputted to a visual adaptation 
>rocessing part shown in the Figure. At a light source information 
>rocessing part 21 of this processing part, the kind of the light source is 
liscriminated based on the white balance coefficient as mentioned above. 
Jased on this discrimination, the matrix corresponding to the discriminated 
;ind of the light source is selected by a matrix storage part 22, while using 
his matrix, the matrix operation of input image data is performed at a 
natrix operation processing part 23, and required image data is provided. 



,22 



EGAL STATUS 

Date of request for examination] 1 3.1 2.2002 

Date of sending the examiner's decision of rejection] 07.06.2005 
Kind of final disposal of application other than the 
sxaminer's decision of rejection or application converted 
egi strati on] 

Date of final disposal for application] 
Patent number] 
Date of registration] 

Number of appeal against examiners decision of 
•ejection] 

Date of requesting appeal against examiner's decision of 
ejection] 

Date of extinction of right] 



Copyright (C); 1998,2003 Japan Patent Office 



(19)B*Bftfttf (JP) 02) £k §fj 4$ |f £t ^* (A) (H)^mB^B8S# 

#1^9-215000 

(43)&IBB ^9^(1997)8^159 



(so intci." miftft jfftaEisMf fi mimmffiVt 

H0 4N 9/73 H0 4N 9/73 A 

9/04 9/04 B 



*3ES:& W*JSO*10 OL (4 6 1) 



(2i)ms#^ 


ftmVS- 16697 


(71)tnKA 


000001007 










(22)ffi«B 


¥J£84£U996) 2/i IB 




jiaoi&fcBKm^ 3 t i3os 2 ^ 






(72) mmm 










«S^PABaKTiLT3TB30«2^ 














(74) res a 





(54) Bg9J<Z>£jfo] aH^e*5£t^#^*!LSE**fe 



(57) 

inform m.mk=f-fch<Dm&.m^\-s.. ^mm<D* 



^ — 
o 



Vg 

UK 



4? 



K 



*t\ CO 
I B 



fk 2 



1 

[IM912 3 hn'7>^ffl^f *> 

iicDxf-^i, com©*-?-* 7"rMsu/cia^ 

fi#«c*«O«fett*iJ:i3fAIH©efiUltWtt***0te 10 

[fin&s 3 3 &£&*w®k. * v 4 v 

^ - * £T 4SHftWI»*fflt»T&aE»*!Hl-r -5 

4>©-C* 5C£ *»3#1 1 fBiS©Jl^«S= 

[l»3}Sg4] fe^&Ma^&tt. EVKa7^-$ 

£ -r *»»ra»«:flHr »rftsawe«"r «fe©-e*sci 

C &*««fr SillJfcJB 3 */c«lf^4feig©»^ 20 

So 

& c i * w»i -r *»3j0B 3 * ittmsm 4 ibo;©*** 

[n#£ 7 ] SttHKt*:. -7 h y * j: 
H»T*3C4*«p»£-rS»#JRl. fft*^3, 311$ 
91 4 ©C » r ft*> CClBig©»^go 

3, fi#:>I4©t,>r*i#>fciBi£©Jt«^g„ 30 

©ifcO^&Mlfe©**' 6 illRS ft £ C £ £ £ "T £ i» 
III#B3. If3^4©l>?ftfetcfeig©&fe& 

So 

[BB3JS8U0 3 KftBMRtt. *6*»C«>fflaE3nfcl 

[0 00 1 ] 40 

sn-siB^f 1 -^ *, AHi©e©j&*.©wtt**.*ofc 

[000 23 

©Jti»». ia^*©a* : 2:ff#fii©a£-rs^ , 7'r 

9»«M^r&j£«©fij£(2iiftS»©%KtB«l©&^ so 



4$H¥9 - 2 1 5 0 0 0 

2 

j»7 *j*sa-c*n«R, g, b. ;u*jw«e 
■e*ti«M. g. y. c<Dtti?ti<Dm^<Dy<< i>*ffi 

[000 33 

[»W**»ifcUJ: 5 £■$-*»«] U*>U&**6ffi*f©* 

K^-rSBBiWDJ** 0 <fc 0 U-c;U©fetoS*5 
#&6ftT<,>s©j!>«itKr&£. -rftto%*iiR©»& 
tt. 4B«tCJ e AIHI©ejffljW*ttr**fe«l£:tt**J«l/fc 

fe*&a#3fc«> 6 nr <,» s. eee*©* 9 w h 

^5>^«HB^wctt*w©»fett. *»J:cfe«iett* 

ttC©<£5&tK&©fc£^&3ftfc4>©-C&£. 
[00043 

[HUBfcJBfcT *&»©*«] *I6W«. fi£*©#?®© 

5 > ^«ma©«^**ffl©tiMR«c»-3* . *©36ascc 
*fc»«iRu *©SBWH**fflir»Tasaft«ffli% 

Vfi CiCCjrO. AIB©fe»flltWtt*3(E»*l«0 A:1B* 

£»£4>©T?&£. 

[ 0 0 0 5 3 < #26HJ«. KftSIB*;*© 

(1), (3) ~ ( 1 0) <DtisK)immi>. mmmn 

*Bffl2rt**&© (2) © £fc 9 (Cltf^* £>©-?&.*>. 
[0 0 0 6 3 ( 1 ) . C©SWMt-?©aAfi 

#©£. c©*-7-T h^>^«a#|R©HJ*fl|-9K:* 
M©sifei4*i «t cfXB©esa««tt**a[ oya©»M« 

[0 0 0 7 3 <2) HiW3#tc*"7^ 
tf^Sl©^^^ 7*£, COSlO^fyT'TjSIl/fc 

a^ft-^ cc^is©viife&*j j; o* Anu©SjaijiM*tt*** 

^a^ffi. 

. [000 81 < 3 ) feSE8M!Hl#a«:. *«7-fh^9> 
^fl«*^?^ - 5? £ T *SHft«»*fflt>reaBft*!Hl 

-rsfe©r*SHtrie < 1 ) astt©tffM£B. 
[00093 ( 4 ) n^mm^mt. evma 7J ( 
- * i -r s^M^^ffli^-ce^^a-r -5 ^>©r $> z> 

IWE < 1 ) IBS^©Jl«^g„ 

[00103 (5) '<9^-**»fl«*©tBaa»fc# 

«?)SbuIB (3) S3t« (4) IBtg©Jt^g„ 
[00113 (6) *^-fe>-!f-©tH*36»i& 

^siuia (3) sfct* (4) eis©jifluKs. 
[00123 ( 7 ) ioRHft»v v h y i>*m.mt&z> 

^&ratfcT?&£BulB ( 1 ) , ( 3 ) . (4 ) ©l»-r*l36> 
{ClBl£©»^lg. 

[0 0 1 3 3 ( 8 ) 3ESm9U2. ;b v t>7 v ^7— 
tC«tSSE»IW»r*ailirgE ( 1 ) . (3) . (4>©lr» 



(3) 



#P8¥9-2 1 5 00 0 



10 



20 



[0014] (9) SSWJBW*. 
ffig©$©^Mft©#*>6aiR5ft&iiiiiE ( 1 ) , 
( 3 ) . ( 4 ) ©l»^ftfr KiB*©JifcSES. 

[0015] ( i o) $mmm*. &t>frc&mM2ti, 

5C<fc 9 1«IE£ft*Jfc> 6*1 StiffE ( 1 ) , (3). (4) 
[0016] 

[ft9J©3Gtt©j$flt] «T«c#*MI!©*Jfc©JBffi* "» 

©HJfeWc J: 0 # U < f&HJf S. 
[0017] 

l ) 1 *Hffi*#JHl/'C 

Ki»B^T-2>„ H«t>. 1 lt*u>X*"C*Dv ^Wn- 

RSStin^-SCCD 1 3SCC|££f&&J;5{C&- 3 -Cl,> 
5. CCD 1 3iA/DMl 4{C«fcrj«P|Eft*H:f s 
5^*;WS#^iSBftStiS. *StJfcWCc*ji,>Ttt. life 

jW3-*bm (v-tz>#) , g (^y->) . y Wi- 

O) , C (->7» ©«-^-C*So ^C* 1 ?^ 1-^*5 > 

n. c©a*ic*ji,i-cM, g. y, c©m#ffi* s ^u< 

[0018] 
M.,=M. XM, 
G. , = G. X G, 
Y..=Y. XY 5 

C. =C. xc, ( 1 ) 

tctcb, M. , G. , Y. , C. H*7-fh^7>X# 
ft. M. . G. . Y. . C, ttA/D X»Ur»6h 
ftffta?f*©fV*;HI*l. M... G... Y... C..IJ* 
«7-f h/^>XMfflfg©{a-5rc*&,, 2£3«gWC*><,> 

[o o i 9] *7-r h^*7>^50ia$nytff-^M. s , g 

.s. Y... C„. £■€■©# 7 4 h/<9>X««M. , G 
. , Y. . C. ttEK8UtHBB*raWl 6^i3S6n 

So 

[ 0 0 2 0 ] m 2 KffijtiHfE&BSIS 160^0^14* 



. , Y. , C. », 3&BtftMfe&8|S2 1 % 

^>x^ftM. . g. . y. , c. -en-en©ft -^-J: o 

5£ (2) tcfcO^abStiSfiaKiOtftoti*. 
[0 02 1 ] 



WB. 

WB. 
WB y 
WB, 
WB. 



30 



40 



= M. 

= G. 
= Y, 
= 1 



/c. 
/c. 
/c. 

0 



(2) 

WB, , WB, , WB, ©ffi©«H£. 
( 3 ) Zmtcmi? H (filV, ( j = 1 ~ 6 ) 

©a^-^-c&d. Aitm. mmi, sat. 

[0 02 2] 

mi: 

V, <WB m <v 2 
V 3 <WB, <V4 

V s <WB y <V 6 (3) 

[0 02 3] ffiu **»ff(«:*Jl>-Ctt» (2 ) fete 
WC. WB. , WB, , WB, . w 

b c m. . g. . y. o^-rnzmmmic 

[0 024] w±©J: s fcaH^ast^Ajfeaa. 9 a. ® 
3t*T, s*. ^^^^^©i^n-c^-s^^fjsij^n 

So 

[0 02 5] ?|- ^Xl2tggP2 2CCtt£>6#>Da&A7fc 

iB©ejjut4*t4r* *eiaett**JSL"t:*8{>fc 5 o© 

0 ^JJJJS hWtiBIIMfi©ft**aK:. c© 5 -o©v h y 
£*©4i3&»e> 1 o©v 1- V i'X^jllR^n-So 
[0 02 6] — 4 h'^>Zf!tM£tltc{m 
M... G... Y... C. s «?l5ir®I^2 3^££?>n. 
v h y * xiatSgP2 2 J: •) it^tiT < V y 9 x©£6 
»M, 1 <i = l— 3. J = 1-4) {CfcOSS (4) *E 

[0 02 7 ] 



Rtn 




"Mn 


M, 2 


M, 3 


Mm' 


Gm 








M23 


M24 


_Bm . 




.Msi 


M32 


M33 


M34. 



[«2] 



GwB 
.Cw8 



(4) 



[0 02 8] eSQft»liaiJ2 3«:«J: 0 ^ h 'J fXvH#3 50 ti. H6n^R. , G. . B.«B 1 f!i**J«» 



> 



C4) 



ftffl¥-9-2 1 5 0 0 0 



1 7^££i6*l. SSjgj&jfc5K>L owPas s^Ban 

dPa s smv>7 < )\>$MLmifiti&2tm®.7 : -z~-t^. 
[0 0 2 9 ] ccd^^ccut. ^sisswcintf. itm 
[0030] (mmm 2 > j^tjc^bjk:^^©!!^ 

«l!SS0>) l ilaIO-c*-5fcesi>. mtbM l ilUCSB^-cco 10 

t,^r«giB^^BisTSo mmmi tmizzotzmzicm 
?m 1 * mKJiiftMSP 1 6 ta^gpt? & * . c ©tajiii 

®mm&3 lwzmmmi trnmicxu \->^>*& 

RM. . G. . Y. . C. ^A^SftS. COD*'?-!' h 
;-?7>x0i$teSic. 5£ (5) ic±9Jtl?$ftfciIH£© 

[00 3 1 ] 

T = f (M. G. Y. C. ) (5) 
fete I, Mgfc f tt* 7 >f h > 0 feiSgM?: 20 

H„ = f. t » (M. G. Y. C. ) 

tctcL ( i = 1~3. j = 1~4) 
M, 1 = Md n X H, 1 tctc L> ( i = 1 ~3 , j = l 



* * ©^simtttfc «fc o*c c d <Dfrytmm<&m* e> . m 
. , g. . y.. c. -e-n*s^^$n-s>BH 

[0 03 2 ] fiUb. C CT*4t>6nfcfeSST«v h i; 
*XffiiESI53 2^£i§6ftS„ vh'J^^^iEgpS 2tc 

uft^^oftf^t^htias^h^^Md,, (i = 
i~3. j = i-4)*noffli$nti^. feiaiT 

-5 fc&(DttIE06$fc#;&<D5$ ( 6 ) tc «fc 0 e> 

n. -e©siiE^H t1 ( i = i~3, j = i~4>=&5$: 

AP5CDfellBjcB14?:^raS!fCCii3iA^/cJ*«:Vo 
n K r i e s ©fiffll£#H5JI*fliK 

/Co 

[0 0 3 3 ] ffliESn/cv h y < i = 1 ~3 . 

j = 1~4> «M#Ma§P3 3^i^6n. 5£ (4) 4 
JBt>THMfc? r -$'M„. G... Y„. C..«R„ . G 

. , b. m^tnt&ztiz. 

[0034] 



-4) 



(6) 
(7) 



[0035] (mmm 3 > vx-ric*&micfct>z>3mw 
§P3 l-cizmt&mztizmte'o. Eviw^ns. 

H;**ffliiEg|53 2(t<fc9, T h VfXVmiE&ft 5. 
C <D E V fig ttS ^ $ ti X {, (, ^ -b > if $ tc « C C 
DCCj;0**-2)C<!;*5-C#-5>. #g|iifeWc:tel,>TfcJ:C C 



Hi,= f.» (EV) fc/dL ( i = 1 ~ 3 , j = l~~4) 
£rFJQ6#J2 tfflffilCffilEZtltc-? b y ^XM M ( i = 40 (D%}M&nt>tl2>. 

1-3, j = 1 ~4) »vH#MSgP3 3^-tmt>tl. 5£ 

(4) Srffll^rBlRf'-ifM... G... Y... CISR 
. , G„ . B. fi-^iSE»3tl*. 

[0 0 3 8 ] 2HWSWfcfeC»r»EVffl*flH,»Tf t 7 ! (- 
;uhvh y ^^cDffliE^^&r. ffliEvhy^^^ 

e.^D»ffi-«(D^CD-7 h y f^^lfL, E VfflKJ: 0 

h y ^x©**^ 1 -?©7 h y ^^*3ilR-r^,i; 

[0039] JWT^ffiw 1 tmm<Dtmft'ift>ti. mm 



50 



58 [0 03 6] E Vfit#H£< teZtm&QKDSjXmfttf 

^^<^s« $fcE vfit*5^:#< nz>tm<&$?(D; ax 

30 Ci(Cf«l^TLx$^= *CT?. #<D5J: (8) ^t^Tffl 
XE^€r**-S<D/c*^ C©M^WE Vfii^/jN$ i,*m-& 
«v h y **©feyy>£Ttf£1§IEi&ifc. tfcEVffi 

1~3. j = 1 ~4) tfohfrCibmMSti-CD&f? 
*)V b<D~? b >J i7XJCj;«35S; (7) £JSt>-r. ffliEvh 

[0 03 7] 

(8) 



[0040] (mi&W4 ) WTCC^Bjoc^^s 
[0 04 1 ] rh>7^ H^*5>^^M. . G. . Y. , 

c. i&tmtim9mt&4 1 iinens. ytmimsemttii 



(5) 

7 

. . Y. . C. ■€'ti*tl©fi#«t»)SS (2) lC£f)m#> 
[0 042] flHgjftRtfAjHR. 9B. 3t:fc*T. S*. 

MS. Site. ^^^^^©vllfettfci^AFaofeftim^f 

lira ccjc 9 3&e> & o fc. 

[0 043] JJLbM/ » » 7'r-7*;Kt<fc K>m^- 



G„,. Y. s , CttR. , G. . B. ft-^-i 



#KI¥9 - 2 1 5 0 0 0 
8 

[0044] 

[01] mMWi<D-7av?m 

[02] SOSW 1 KfcW *«JWB6*affl»®^ , o » * 

0 

[03] JGffem, |S*W3K4s»StaJIOHl6*a®3P 

©t'p -j vm 

[04] ^5s^4 (c*$w &ym.m&%m3b<D7u -j z 
0 

[#-^©l&nj] 

i 3 umm* 

15 * 7 h ^ >X^SSP 

1 6 toxmxsm 



[0i ] 



11 12 



16 



15 



16 



A/D - 



17 



18 



1 



«««5 



[H23 



MmGwsYmi Cw$ 



21 



22 



23 



war-* 

RmGm Bin 



C6) 



1$g3¥9-2 1 5 0 0 0 



[03] 



31 



,32 



Jl 



33 



RnjGm Ben 



[04] 



- ? 



A) 



j: 



42 



r^3 



-9 

RnGtn Bin 



THIS PAGE BLAM& (usro; 



